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1 Introduction 

Probability theory is the logic of propositions under uncertainty where deductive reasoning 
is not possible. Because predicates can be viewed as a family of propositions parameter- 
ized over some set, a better characterization is that probability theory is the logic of 
predicates under uncertainty. In estimation problems such predicates are often specified 
as a probability density function defined on the parameter space. The main obstacle to 
the further development of this "predicate logic under uncertainty", to lay claim to a 
first-order logic under uncertainty, has been the treatment of quantifiers. In the 1960's 
the main obstacle to the further development of algebraic logic was also the treatment 
of quantifiers. Categorical logic solved this problem elegantly with the recognition that 
quantifiers are adjoint functors. This "quantifiers as adjoints" paradigm can be applied 
to the Kleisi category of the Giry monad, denoted Adeasr, whose objects are measurable 
spaces and arrows X — > Y are measurable functions X — > TY assigning a probability mea- 
sure on Y for each x e X. By conceptualizing quantifiers as adjoints the deterministic 
existential and universal quantifiers are extended to include nondeterminism. 

The term "probabilistic" is used to mean either deterministic or nondeterministic 
where the latter two terms have a precise definition stated in section 2. Under this con- 
vention our purpose is to generalize the deterministic existential and universal quantifiers 
to probabilistic quantifiers for the category Aieasx- 

In the literature probability quantifiers have been studied almost exclusively from the 
model theoretic point of view [UEJEET]. I n these models the quantification (Fx > r)(-0(x)) 
refers to a set {x|^(x)} having probability measure at least r. The existential and univer- 
sal quantifiers introduced here are fundamentally different in that these quantifiers do not 
require the condition ifi defining the subset to be deterministic, and these probabilistic 
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quantifiers quantify over probability measures. From the categorical perspective quantifi- 
cation over the points of the category is the appropriate generalization of the deterministic 
concept, and the points of the category M.easx are probability measures. 

This paper is organized as follows: Section 2 defines and gives the basic properties 
of the category Aieasx- Section 3 reviews deterministic quantifiers as adjoints in the 
category Sets. Section 4, where new results are presented, then extends the deterministic 
quantifiers to the category Aieasr giving probabilistic quantifiers. 



2 The Kleisi Category of the Giry Monad 

We denote the category of measurable spaces by M.eas. Given an object [X, Ex) in 
Adeas we often denote it simply by X. The Giry monacQ is the endofunctor T defined 
on M.eas by the function defined on objects X by 

TX = The set of probability measures on X endowed with the initial a — algebra 
Etx generated by the evaluation maps 
ev A : TX ->■ [0,1] 
: P ^ P[A] 

for A G E x . 

and the function defined on measurable functions X — > Y by T(f)P = P G TY. 
The unit of the monad T is the measurable function X — ^» TX given by rjx(x) = 8 X , the 
dirac measure on X at x. The multiplication of the monad is T 2 X TX defined at 
Q G T 2 X by the probability measure Hx{Q) on TX at A G Ex by 



Hx{Q)[A\= [ q[A}dQ. 



The Kleisi category of the Giry monad, denoted AieasT, thus has arrows X — > Y 
denoting a measurable function X — > TY and the composition X — >■ Y Z in 
AieasT, denoted g • /, is the composite of the measurable functions 



/ Tg n z 
X > TY > T 2 Z > TZ in Meas 

with the composition in Aieas being denoted as \iz ° Tg o f. The context will make clear 
whether an arrow / is to be interpreted as an arrow of Aieasx or Aieas. 

The image of a point x £ X under the composite g • f is the probability measure on 
Z defined at C G E^ by 

r g(y)[C]d(f(x)). 



1 The theory of monads can be found in the text [U E]. The Giry monad is given in [3]. 
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The identity arrows in Aieasx are given by the unit r]x of the monad for each object X 
in AieasT- We denote these identity arrows in JHeasr by 77 or 1 rather than Id because 
the measurable functions TX — y TX play a significant role as arrows TX — » X m 
Meas T - This significance come from the observation that by treating P G TX as the 
variable argument it follows that for each A G Ex the evaluation map etu(-) '■ TX —y [0, 1] 
satsifies cva(P) = Id(P)[A]. Thus the a-algebra of TX is that induced by the A4eas T 
arrow Idrx- 

Deterministic and Nondeterministic Maps Every measurable mapping in the cat- 
egory of measurable spaces, 

X -A Y in Meas 
may be regarded as a Measx arrow 

X Y in .Meas T 
defined by the dirac (or one point) measure 



$f(. x )[B] I q th erw i se 



Thus Sf assigns to x the dirac measure on Y which is concentrated at f(x). 



p 



Definition 2.1. A Meas? arrow X — y Y is deterministic if and only if for every B G Sy 

the measurable functions X — ^> [0, 1] defined by Pb(x) = P(x)[B] assumes a value of 
either or 1. 

Any M.eas T arrow which is not deterministic is called nondeterministic. The following 
result provides a useful characterization of deterministic mappings. 

Theorem 2.2. Let (Y, Ey) be a countably generated space. A Aieasr arrow X — y Y is 
deterministic if and only if it is determined by a measurable function f so P = Sf. 

Proof. If P = Sf for some measurable function then it assumes a value of either or 1 
so is deterministic. To prove the converse let Q be a countable generating set for Ey. 
Then Q = {G\G E Q or G c G G} U {Y, 0} is a countable generating set. Suppose for each 

Beg that P B = P(-)[B] assumes a value of either or 1 on X. We claim there exist a 
measurable function / : X — y Y such that the diagram 



X [0, 1] 




Xb in Meas 



Y 
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commutes, where xb is the characteristic function. 

For each x G X let xi = {B G Q \ P B (x) = 1} and xq = {B G Q \ P B (x) = 0}. If B G x x 
then the condition Pb = Xb ° f requires that / : X — > Y satisfies f(x) G Hxi. We claim 
that flxi 7^ 0. If flxi = then Uxo = Y. Since Q is countable this implies there exists a 
countable covering of Y by measurable sets in xo which can be used to generate a countable 
disjoint cover {Cj} ie N of Y by measurable sets Cj G £y satisfying P(x)[Cj] = 0. By 
countable additivity of the measure P(x) this implies P(x)[Ui e mCj\ = P(x)[Y] = which 
contradicts the required hypothesis of P(x)[F] = 1. Thus flxi ^ and for each x G X 
we can choose any set function / satisfying /(x) G Rxi. Then the condition Pb = Xb ° f 
holds for all x E X and all P G Q. 

It remains to prove that / is measurable. Since {1} G £>[o,i] we have Pg^-fl}) G £x 
and so ^({1}) = f^ix^A 1 }) = f~H B ) e s x- Hence / is measurable. □ 

Predicates In the category of sets, Sets, the object 2 = {_L, T}, which we identify with 
{0,1}, plays a special role, and in the category Aieasx it also plays a special role. In 

AieasT we endow 2 with the discrete a- algebra and a AieasT arrow X — > 2 evaluated at 
x £ X gives a probability measure on 2 and /(x)[{T}] represents the probability of truth 

of the predicate / at x. Alternatively, since T2 = [0, 1] any MeasT arrow X — )• 2 is 

equivalent to a measurable function X — > [0, 1] and consequently we identify any AieasT 
arrow to 2 as a measurable function to [0, 1] with the restricted Borel a- algebra of R. 

3 Deterministic Quantifiers as Adjoints in Sets 

In the deterministic setting the existential and universal quantifiers can be viewed as the 
left and right adjoint functors to the substitution functor, with these functors operating 
on posets [8l [TP] . Here, in the category of sets, the basic concepts are well understood 
and put into the proper framework their extension to the category AieasT is possible. 
Hence we first summarize the deterministic quantifiers from the well-known viewpoint of 
quantifiers as adjoints in the category Sets and then extend it to the category AieasT- 

In the category of sets, the set of arrows from X to 2, denoted Sets(X, 2), can be 
given a partial ordering by defining, for g,h G Sets(X, 2), 

g \~x h 
if and only if 

Vx G X g(x) < h(x) 

where the ordering on Sets(X, 2) is determined by the ordering _L < T (0 < 1) on the 
set 2. Thus if g \~x h then, for all x G X, the truth of g(x) implies the truth of h(x). 
Sets(X, 2) can be interpreted as the set of predicates on X and the relation g \- x h 
construed as the predicate h is at least as true as the predicate g. This partial ordering 
on Sets(X, 2) makes it a poset category with the objects being predicates and at most 
one arrow between any two objects. 
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Let X — > Y be an arrow in Sets. Since precomposition preserves ordering, 

#h y h=> g o / h x ho f 
each such arrow / determines a functor between the posets, 

Set(Y,2) ^ Set(X,2) 

g >->■ g° f 

The quantifiers 3/ and V/ are left and right adjoints, respectively, to this "substitution" 
functor /*. 

If g is a predicate on X and X — > Y then the quantifier 3 j can be illustrated by the 
noncommutative diagram 



/ 

X > Y 




(3 ' 1) 



where the dashed arrow 3$g is a predicate on F determined by the predicate g and arrow 
/. By defining 

(3fg)(y) = sup{#(x) | y = f{x)} 

x<=X 

it follows 

g h x 3 f g o / 

and if h is any predicate on Y such that g \- x f*(h) then 3jg hy h. 

Thus knowing the relation g \~x f*(h) we can infer the relation 3/g hy h and vice 
versa. This is a powerful inference tool in classical logic and expressed by 



9 f*(h) 



It (3.2) 



3 f g hy /i 

where the vertical arrows indicates that the truth of one relation infers the truth of the 
other relation. 

This adjunction is expressed by 

3 / 

Sets(X, 2) j Sets(Y, 2) 3 f H /* (3-3) 

/* 

Defining the quantifier V/ by 

(V/#)(y) = inf {g(x) \y = f(x)} 
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yields the adjunction 



Sets(Y, 2) j = Sets(X, 2) /* H V, (3.4) 
V/ 



and is summarized by the bijective correspondence 

f*(h) 9 
h \- Y Vjg 



(3.5) 



By generalizing the definitions for the quantifiers 3/ and V/ both of these adjunctions, 
expressions 13.31 and 13 A\ also hold in the category Aieasx where the familiar deterministic 
concepts are extended to include nondeterminism. 

4 Probabilistic Quantifiers 

4.1 Partial Order Relations 

Let X be any object in M.easx- Given two predicates gx,g% \ X 2 define a partial 
ordering on JHeasT^X, 2) by 

9i 92 

if and only if (4.1) 
Vx e X gx(x)<g 2 (x). 

We interpret the expression u gi \~x #2" as 

The predicate 92 is probabilistically at least as true as g\. 
The set AieasxiX, 2) can be viewed as a poset category. 

4.2 The Probabilistic Existential Quantifier 

Suppose Y is a measurable space with a countably generated a-algebra and. let X — > Y 
be any M.easT arrow. Since precomposition preserves ordering on posets we have the 
"substitution" functor 

MeasriTY, 2) A Meas T (X, 2) (4.2) 

defined by f*(h) = ho f. 
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We would like to construct the left adjoint 3/ to this substitution functor /*, and 
consequently we need to construct a universal arrow as shown by the dashed arrow in 




X [0, 1] TY ^4 [0, 1] 



\~X \~TY 



X ^4 [0, 1] TY -±> [0, 1] 



(4.3) 



so that the bijection 



in Meas T (X, 2) in Meas T {TY, 2) 



9^x f*(h) 



3 f gh TY h (4.4) 



holds. This is the same bijection as expressed in Equation 13.21 for the deterministic 
existential quantifier, only the categories have changed. This desired universal arrow, in 
Meas T (X,2), 

g\- x 3 f gof (4.5) 

expresses the condition that g(x) < 3fg(f(x)) for all x G X. We now proceed to show 
that such a universal arrow exists. 

Lemma 4.1. If (Y, Ey) is a measurable space with a countably generated a-algebra then 
(TY, Y*ty) has a countable generating set and for each Q G TY the set {Q} is measurable. 

Proof. If Q be a countable generating set for Ey, then % = {{e% 1 (r, s)}, for B e Q and 
r, s G Q with (r, s) C [0, 1] is a countable generating set for TY, and 



{Q} = n Ben B* where B* 



B HQ e B 
B c if Q £ B 



□ 



Lemma 4.2. Suppose X and Y are measurable spaces with Y having a countably generated 

a-algebra. Let X — — )■ F and X — 2 6e iwo Aieasr arrows with f surjective. Then there 
exists a Vrpy-minimal object 3fg in the poset M.easT{TY,2) satisfying 

g^ TY 3 f gof (4.6) 

Proof. First note that if Ey has a countable generating set then, by Lemma 1, E^y has a 
countable generating set, say Q' . Then Q = Q ; U{B C | B G Q'} where B c is the complement 
of B in Y is a countable generating set for E^y also. 

To prove the lemma we do it in two steps, first assuming the measurable function g is 
simple, and then letting g be an arbitrary measurable function in AieasT{X,2). 
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Step 1: Suppose g is a simple function with standard representation 

n 

9 = Y1 a ' iXA > 

i=l 

where {A}™=i is a family of disjoint measurable sets of Ex- Define Bi by 

B t = p| b 

Bee 

A z C / — 1 (-B) 

Thus is the smallest measurable set in TY whose preimage under / contains A^. 
Then for each i = 1, . . . , n the function hi = aiXBi is a measurable function on TY and 
consequently 

h = sup {hi} (4.7) 

i=l,...,n 

is a measurable function on TY and satisfies g(a;) < h(f(x)) for all x G X. Moreover 
we claim that h is the minimal object in AieasxiTY, 2) under the relation \~ty satisfying 
the Condition 14.61 when g is a simple function. To observe this note that for any Q G TY 
such that XbXQ) = 1 there exists an x G Ai such that /(x) = Q G -B«. If there was no 
such x E Ai then, since Lemma 4.1 shows {Q} G S^y, the set B* — Bid {Q} c would 
be a measurable set in T^ty with B* strictly smaller than Bi satisfying Ai C 
contradicting the fact that £>j is, by construction, the smallest measurable set of S r y 
whose preimage under / contains A^. Thus it is necessarily the case that there exists an 
x G Ai such that f(x) — Q and consequently it is required that 

en = g(x) < h(f(x)) = h(Q) (4.8) 

so h(Q) must be at least sup{hi}. Since h is chosen to be the least upper bound it clearly 
satisfies Condition 14.81 for all Q G TY and hence the object h = 3fg G Aieasr{TY, 2) 
satisfies the desired condition 14.61 

Step 2: Since g is £>[o,i] -measurable there exists a sequence {if) n } n of measurable simple 
functions satisfying ip n {x) — > g(x) for each x & X. By step 1, for each n there exists a S^y- 

measurable function h n : TY — > [0, 1], defined by h n = sup {hi}, such that -0n \~x h n o f 

i=l,...,n 

with /i n the h-ry-minimal such object in AieasT{TY, 2). Next, define 

= lim sup /ij = inf sup hi 

n-Kxj i=i ) ... )n n i=l,...,n 

which is Ery-measurable. From h n (f(x) > if) n ( x ) ~^ g( x ), it follows that 3fg(f(x)) > g(x) 
for all 3; 6 X, or equivalently g \~x ^f9 ° f and since 3fg is the infimum of the sequence 
/i„ of functions satisfying h n (f(x) > ijj n ( x ) ~* d( x ) it follows that 3/g is the l-Ty-minimal 
object in the poset AieasT^TY, 2) satisfying the Condition 14.61 □ 
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Lemma 4.3. If the space Y has a countably generated a-algebra then the topology r 
generated by the metric defined on TY , for R, Q G TY by 

d TY (R,Q) = sup {\R(B) - Q(B)\} (4.9) 

BeT, Y 

has the Borel algebra B{r) coinciding with E^y. 

Proof. Let Q denote a countable generating set for Ey. Then the a-algebra E^y is count- 
ably generated by the sets ev^ (r, s) for r, s G Q, with (r, s) C [0,1], and for B G Q, where 
cvb(-) = Id(')[B] : TY — > [0,1]. We show each generating element eu^ (r, s) G 6(r). 
Around each point R G ew^ 1 (r, s) we can put an open ball contained within that set. 
Since 

ev^ir, s) = {ReTY\ R(B) G (r, s)} 

so if Q G ev~j^(r, s) with say, Q(-B) = u G (r, s) then choosing 5 = mm(|r — u\, \s — u\) 
gives S$(Q) C ew^ 1 (r, s). Taking the union of all such balls around each point in ev^(r, s) 
gives the union of open sets 

[J S S (r){R) 

R&eVg (r,s) 

where 8(R) = min(\r — R(B)\, \s — R(B)\), and is consequently an element of B(r). Thus 
each 

evs\r,s) G B(r) 

and since these generate E^y it follows Eyy C B{r). 

Now we show the reverse inclusion B(t) C E^y. Consider the open ball 

S e {R) = {Q | d TY (R, Q) = sup {\R(B) - Q(B)\} < e}. 

Belly 

We have, for the countable generating set Q, 

S e (R)= f)eVz l (R(B)-e,R(B) + e)EZ TY . 
Beg 

Thus we conclude B{r) C S^y. □ 

Lemma 4.4. Let Y be a countably generated measurable space. Consider the measurable 
space (TY,Tjty), and let A be a subset of TY (not necessarily in Hty)- Let h be a real 
valued-function on A measurable for E^, the subspace a-algebra. Then h can be extended 
by zero to a real-valued function on all ofTY, measurable for Eyy. 



Proof. This is J2j Theorem 4.2.5] where we have used the result of Lemma I4T31 so that the 
topological space induced by the metric d has the Borel algebra which coincides with the 
induced a- algebra E T y. □ 
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Let (f(X), denote the image of an Aieasx arrow X — > Y which is not nec- 

essarily surjective, with f(X) having the subspace a-algebra. By Lemma 4.2 there exists 
a h j(x)-minimal object 3fg\f(x) such that g \~ftx) ^fd\f(x ° /• Define the extension of 
3/<7|/(x) by zero using Lemma S3 

X — - — » (f(X),T,f( X )) > — - — * TY 

n i (4-10) 

^f9\f(x) / in Meas 





[0,1] 



where i is the inclusion mapping. The measurable function 3jg is the h^y-minimal object 
extending 3fg\f(x) to TY. This establishes the universal arrow g \~x 3/$ o / in Diagram 
14.31 and hence the bijective correspondence 14.41 

If Y a countable space then, using the fact that for each probability measure Q on Y 
the singleton {Q} e S T y, the expression 3fg reduces to 

3 f g(Q) = su V {g(x)\Q = f(x)}. (4.11) 

where we use the fact sup = 0. However if Y is uncountable then such a simple expression 
need not exist. 

Given g\ \~x g?, it is clear that 3^gi h^y 3jg 2 so that any AieasT arrow X — > Y 
determines a functor of posets 

3/ C4 i2) 

Meas T (X, 2) > Meas T (TY, 2) y ' J 

given by the above construction for 3f. 

The existence of the universal arrow g \~x 3/<? ° / for each g e A^easr(^, 2) and the 
functoriality of 3/ establish 

Theorem 4.5. Let Y be a measurable space with a countably generated a-algebra. For 
any AieasT arrow X — > Y the adjunction 

Meas T (X, 2) ; Meas T (TY, 2) 3/ H /* 

r 

holds. 

This theorem could equally well be expressed as 

Meas(X, 0, 1 ) , Meas(TY, [0, 1]) 3/ H /* 

with the partial orderings defined on the sets of measurable functions making them poset 
categories. By consideration of composites of existential quantifiers the following result 
suggest why the formulation in terms of /Aeasx is appropriate. 



4 PROBABILISTIC QUANTIFIERS 



11 



4.3 Composites of Existential Quantifiers 

Let X be a measurable space and Y and Z be measurable spaces having countably gen- 
erated a-algebras. Consider the M.easT diagram 

/ 9 

X > Y > Z 



9'f 

The three meaurable functions /, g,and \±z (viewing the Aieasx arrows / and g as mea- 
surable functions) give the sequence of adjunctions 

3/ 3 Tg 3 Mz 

Meas T {X, 2) , Meas T {TY, 2) , Meas T (T 2 Z, 2) , .Meas T (TZ, 2) 

/* CW ^ 

between posets. On the other hand we also have the adjunction 

Meas T (X,2) = => ,Meas T (rZ, 2) 

(<?•/)* 

where we view g • / as a measurable function X — >• TZ. Given the two adjunctions, 
=W 3 (9 9 f)* an d =W o 3 Tff o 3 j H (fx z o Tg o /)*, and by definition of composition in 
.A/leas^, • /)* = (/Az °Tg o /)* it follows the functors 3 ff ./ and 3 Mz o 3 Tff o 3j are both 
left adjuncts of (g*f)*- In general, adjuncts to a given functor are defined up to a natural 
isomorphism. However since the categories are posets it follows that 

^ = ^0^0^ (4.13) 

or equivalently, 3^ zoT9o/ = 3 Mz o 3 Tg o3 f . 



4.4 The Probabilistic Universal Quantifier 

f 

Let X — y Y be a Aieasx arrow with Y a countably generated measurable space. To 
construct a right adjoint to the substitution functor given in Diagram 14.21 we need to 
construct a universal arrow as shown by the dashed arrow in Diagram 14.141 



TY ^4 [0, 1] TX ^ [0, 1] " " " " "> TX -1+ [0, 1] 



TY 



X 



(4.14) 



TY [0, 1] TX ^4 [0, 1] 



in Meas T (TY, 2) in .Meas T (X, 2) 
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It (4.15) 



so that the bijection 

h o f h x g 
holds. 

The functor V/ : AieasT{X,2) — > M.easT{TY,2) can be defined in an analogous 
procedure as that for 3j by altering Lemma 4.2. 

Lemma 4.6. Suppose X and Y are measurable spaces with Y having a countably generated 

a-algebra. Let X — — >■ Y and X — 2 6e two A^easj 1 arrows with f surjective. Then there 
exists a V TY -maximal object V/<7 m £/ie posei .Meas^Ty, 2) satisfying 

y f gofh x g (4.16) 

Proof. First note that if Ey has a countable generating set then, by Lemma 1, E^ry has a 
countable generating set, say Q' . Then £/ = (7'U{.B C | B G where B c is the complement 
of B in y is a countable generating set for E^y also. 

To prove the lemma we do it in two steps, first assuming the measurable function g is 
simple, and then letting g be an arbitrary measurable function in AieasT(X, 2). 

Step 1: Suppose g is a simple function with standard representation 



E 



9 = / „ 



where {^4j}" = i is a family of disjoint measurable sets of Ex- Define Bi by 

Bi= p| b 



see 



Thus Bi is the smallest measurable set in TY whose preimage under / contains A4. 
Then for each i = 1, . . . , n the function hi = aiXBi is a measurable function on TY and 
consequently 

h = inf {/ii} (4.17) 



=1, 



is a measurable function on Ty and satisfies h(f(x)) < g(x) for all x £ X . Moreover we 
claim that h is the maximal object in AieasT{TY,2) under the relation \~ty satisfying 
the Condition 14 . 1 61 when g is a simple function. To observe this note that for any Q e TY 
such that XbXQ) — 1 there exists an x G A± such that f(x) = Q G B^. If there was no 
such x e Ai then, since Lemma 4.1 shows {Q} G S T y, the set B* — Bid {Q} c would 
be a measurable set in Ety with B* strictly smaller than Bi satisfying A4 C J _1 (B*) 
contradicting the fact that Bi is, by construction, the smallest measurable set of Ety 
whose preimage under / contains A- Thus it is necessarily the case that there exists an 
x G A; L such that f(x) = Q and consequently it is required that 

h(f(x)) = h(Q) < g(x) = ai (4.18) 
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so h(Q) must be at most inf {hi}. Since h is chosen to be the greatest lower bound it clearly 
satisfies Condition 14.181 for all Q G TY and hence the object V/(? = h G MeasxiTY, 2) 
satisfies the desired Condition 14.161 

Step 2: Since g is £>[o,i] -measurable there exists a sequence {"0 n }n of measurable simple 
functions satisfying ip n (x) — >■ for each i6l. By step 1, for each n there exists a E^y- 

measurable function /i n : TY — > [0,1], defined by /i n = inf {/ij}, such that h n o f \- x ip n 

i=l,...,n 

with h n the h-py-maximal such object in MeasriTY, 2). Next, define 

V/5> = lim inf /ij = sup inf foj 

n— >oo i=l,...,n n i=l,...,n 

which is Syy-measurable. From h n (f(x)) < ip n ( x ) ~^ 9{ x ), it follows that V/g(/(x)) < 
for all x G X, or equivalently V/# o f \- x g and since V/g is the supremum of the sequence 
h n of functions satisfying h n (f(x)) < ip n ( x ) ~^ 9{ x ) it follows that V/^r is the h^y-maximal 
object in the poset M-easriTY, 2) satisfying the Condition 14.161 □ 

In constructing the right adjoint to the substitution functor, just as in the Diagram 
14.101 for the existential quantifier, we have the diagram 




where (f(X), is the image of / with the subspace cr-algebra, i is the inclusion 

mapping, and to extend the measurable function V/l/pr) from f(X) to TY we take the 
extension of this measurable function by the constant one. (In Lemma fl~4l the measurable 
function can extended by any real- valued constant.) The measurable function V/<7 is the 
h-ry-maximal object extending V/^|/m to TY. This establishes the universal arrow 
g \~x 3/^ o / in Diagram 14.141 and hence the bijective correspondence 14.151 

The argument applied to the existential quantifier to show 3/g is the object part of 
the universal arrow g \~x o / applies to show V/g is the object part of the universal 
arrow V/g o / \- x g to obtain 

Theorem 4.7. Let Y be a measurable space with a countably generated cr-algebra. For 
any Aieasr arrow X — > Y the adjunction 



f* 

Meas T (TY, 2) , Meas T (X, 2) /* H V/ 

V, 



holds. 
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If Y is a countable space then the universal quantifier reduces to 

y f g(Q)= mUg(x)\Q = f(x)} 

where we use the fact inf 0=1. 

The composite of universal quantifiers leads to the result, analogous to Equation I4.13[ 



4.5 Continuity 

A special case of interest occurs when X also has a countably generated cr-algebra. Sup- 

pose this is the case and we have the M.easx arrow X — > Y . Define /" by the commu- 
tativity of the diagram 



TX 




in AdeasT 



(4.19) 



where we recall that the AieasT mapping Id is the measurable identity function TX — > TX 
giving rise to the A4easT arrow TX — > X. Thus / is the lift of /" and 



f{P) = (f . Id)(P) 



f{x) dP = f.P. 



Theorem 4.8. Let f and p be defined in Diagram J^.19\ Then /" is continuous with 



respect to the metrics drx and dxy whose forms are specified by Equation 4-9 



Proof. Let {Pi}°Zi — > P be a convergent sequence in TX with respect to the metric 
drx- Observe that convergence in the metric of TX is precisely uniform convergence 
with respect to the measurable sets A G Ey- Let || • || denote the total variation of a 
signed measure. We will use the fact that lim^oo \ \Pi — P\ \ = holds if and only if Pi(A) 
converges to P(A) uniformly in A. 
For each B e Sy by definition 



fKK 



f{x)[B] dPi 



and, in general, for any X measurable function h and signed measure n on X 



/ 



h(x) dfj, 



< 
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where \\h\\oo = sup xeX {\h(x)\}. Taking h(x) = f(x)[B] and /i = p — P, and using the 
observation that | | |oo < 1 f° r all B G £y it follows that 



VP G Ei 



f(x)[B)dPi- [ f(x)[B]dP 



< IIP,: -PI 



'igX JxGX 

Taking the supremum with respect to B G £y of this inequality yields 

d T y{f{Pi)jKP))<\\Pi-P\\ 

which implies, by the uniform convergence of {P{\i which is equivalent to ||Pj — P|| — > 0, 
that {/"(Pi)}i converges in the metric TY. □ 

When X and Y are finite spaces, which implies each space is isomorphic to a finite set 
{x±, X2, ■ ■ ■ , x m } and {yi,y2, • • • , y n } with the discrete u-algebra, the computation of the 
quantifiers (Bpg)(Q) and (ypg)(Q) with respect to the adjunctions 

.Meas T (W, 2) <=» Meas T (TX, 2) Meas T {TX, 2) «=> Meas T (TY, 2) 
V/« /«* 

reduce to solving a linear programming problem. 

Example 4.9. Suppose X = {xi,x 2 ,x 3 }, Y = {yujfy}, 9 = \X{ Xl } + \X{x 2 } + joX{x 3 }, 
which induces the relation g(P) = J x g dP on TX, and X — > Y is given by the Table [TJ 



/ 


{yi} 




Xi 


1 





%2 


1 
2 


1 

2 


^3 


3 
10 


7 

10 



Table 1: The conditional probability /. 



Let P = Y^=iPi$Xi- F° r a e [O5 1] an d Q = a $yi + (1 — 01 ) ^2/2 the computation of the 
predicate (ypg) at Q is given by solving 

1 3 9 
mm -p x + ~p 2 + —p 3 
Pi 2 5 1U 

subject to 

Q({yi}) = f x f( x )l{y±}] dP a = pi + §Pa + ^ 3 

= J x /(x)[{y 2 }]dP 1-a = + \p 2 + > 3 
Pi > for i = 1, 2, 3 
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For a = .7 it follows (Vftg)(Q) = §§ wr th the argmin P = ~5 Xl + ^S X2 + 0S X3 . By 
changing the problem to a maximization problem one computes (3pg)(Q) = ^ with 
argmax P = ~8 X1 + 05 X2 + ~8 X3 . 
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